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This  report  describes  requirements  for  the  flight  tests  of  the  baseline 
•Automated  Terminals  Service  (ATS)  system.  The  overall  objective  of  the  flight 
test  program  is  to  evaluate  the  feasibility  of  the  p\TS  concept.  Within  this 
objective  there  are  two  categories  of  specific  ATS  flight  test  objectives: 

(1)  the  objectives  concerned  with  verifying  the  basic  advisory  capabilities 
of  ATS  and  (2)  the  objectives  concerned  with  evaluating  pilots'  responses  to 
ATS  messages.  The  flight  testing  is  broken  down  into  three  parts.  Part  1 
will  consist  of  system  checkout  flights.  Part  II  will  consist  of  validation 
and  some  pilot  evaluation  tests  and  will  be  conducted  at  NAFF.C.  Part  III 
will  consist  primarily  of  normal  airport  operations  at  a selected  general 
aviation  airport.  The  requirements  for  the  Part  II  and  Til  evaluations  of 
each  of  the  ATS  services  to  pilots  arc  presented.  For  each  service,  there 
is  a listing  of  the  major  issues  involved  in  the  evaluation  and  a discussion 
of  the  methods  to  be  used  in  the  evaluation.  The  description  oi  the  test 
methods  for  each  service  presents  the  type  of  missions  that  will  be  required, 
along  with  a table  showing  the  measures  to  be  taken  and  the  sources  of  data 
where  these  measures  can  be  most  easilv  obtained. 
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PREFACE 


This  document  was  prepared  under  the  sponsorship  of  the  Office 
of  Systems  Engineering  Management,  Federal  Aviation  Administration, 
as  part  of  the  Automated  Terminal  Service  (ATS)  program.  ATS  is 
one  of  a number  of  advanced,  automated  air  traffic  concepts 
being  developed  to  serve  tlic  future  needs  of  the  national 
aviation  system.  Ihe  contents  of  this  document  reflect  comments 
from  various  reviewers  on  previous  draft  versions.  The  author 
wishes  to  give  special  acknowl edgement  to  Charles  0.  I’hillips  and 
Alan  Robertson  for  tlteir  extensive  contributions  to  early  draft 
versions  and  to  Robert  Reyers , NAlil-C,  and  Richard  Telsch,  MITRE 
Corp.,  for  their  helpful  comments  on  the  final  version. 
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1.  INTRODUCTION 


1.1  HACKOROlIXn 

The  I'AA/OSliM  has  generated  a description*  of  the  baseline 
Automated  iermiT\al  Services  (ATS)  concept.  The  primary  emphasis 
of  this  concept  is  to  provide  airport  services  to  pilots  via  an 
unm.anned  , automated  system.  The  baseline  ATS  system  has  three 
potential  areas  of  application.  first,  its  primary  role  will  he 
as  a substitute  for  a control  tower  at  those  airports  just  reach- 
ing the  criteria  for  tower  installation.  Second,  the  system  could 
be  installed  at  uncontrolled  airports  where  a manned  tower  is  not 
yet  justified,  but  where  additional  safety  is  required.  Third, 
the  system  could  be  used  as  a shift  reliever  during  off-peak  hours 
at  some  airports  that  have  a manned  control  tower.  The  ATS  con- 
cept has  been  subjected  to  .iiialysis  and  simulation  iiy  the  MITRb 
Co  rj)ora  t i on . As  with  any  major  system  under  development,  it  is 
desirable  to  conduct  tests  in  a live  environment  in  order  to 
fully  characterize  and  refine  system  performance.  There  is  an 
adtlitional  motivation  for  conducting  flight  tests.  fhe  ATS  con- 
cept relies  in  large  part  upon  the  ability  of  a pilot  to  gain 
access  to  the  system,  to  communicate  with  the  system  through 
various  transponder  codes,  to  comprehend  the  system  messages,  and 
to  choose  an  appropriate  course  of  action  when  advised  of  a con- 
flict. The  human  responses  to  these  situations  are,  therefore, 
important  elements  affecting  the  operation  of  ATS.  The  most 
re.alistic  method  for  studying  those  responses  is  flight  testing. 

1.2  A I S ri.ICIIT  Ti;ST  niUl-CTlVl-.S 

I'be  overall  objective  of  the  fliglit  test  program  is  to  eval- 
u.ite  the  feasibilitv  of  the  .ATS  system.  Within  this  objective 
there  .are  two  c.ategories  of  ATS  flight  test  objectives:  (1) 

thosi'  loncerned  with  verifying  the  basic  advisory  c.ip.ab  i I i t i es 

Office  of  Svstems  Tngineering  Management,  "A  I'oscription  of  the 
i'll. ISC  1 lutoiiiated  fermin.al  l.oncept,"  U.S.  Dept,  ol  T r ,an  spo  r t a t i on  , 
I'ederal  Avi.ation  Admin.,  Washington  lUl , November  lP'’(i,  lAA-i.M  (>•(>. 
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of  ATS  and  (2)  those  concerned  with  evaluating  pilots'  responses 
atid  reactions  to  various  ATS  messages  and  their  ability  to  use  the 
information  conveyed  in  the  messages  in  an  effective  way.  I'he 
first  objective  seeks  primarily  to  assess  how  well  the  system 
generates  messages  when  it  is  operating  with  data  from  a live 
environment.  These  objectives  are  concerned  with  the  mechanical 
and  electronic  aspects  of  the  ATS  system  operation  and  have  lieen 
termed  ATS  Validation  Objectives.  The  second  category  of  ohjec- 
ti\ os  deals  witli  pilot  responses  and  opinions  and  is  referred  to 
as  Pilot  Hvaluation  Objectives. 

1.2.1  ATS  Validat  ion  Objectives 

rhe  most  important  validation  objective  is  to  evaluate  and 
improve,  if  necessary,  the  message  generating  capability  of  the 
ATS  system.  flie  basic  ATS  algorithms  provide  for  the  delivery  of 
messages  depending  o-'  rcraft  speed  and  position,  aircraft  ATC 
status,  and  pilot  intention;  e.g.,  departure  versus  touch  and  go. 
[Hiring  the  flight  tests  the  system  will  be  presented  with  these 
situations,  and  its  performance  will  he  measured  and  evaluated. 

1.2.2  P i 1 o t ^ F. V a luation  Objectives 

The  principal  objective  is  to  evaluate  how  well  all  of  the 
elements  of  the  ATS  system  work  together  to  provide  for  the  safe 
and  efficient  flow  of  aircraft  in  an  airport  environment.  The 
r’bility  of  the  pilot  to  use  the  advisory  information  to  his  henc- 
; i t is  to  be  assessed.  Another  objective  is  to  characterize  the 
pilot's  perception  of  the  timing  and  content  of  the  ATS  messages, 
''ilot  evaluation  of  all  aspects  of  system  operation  is  to  bo 
collected  and  analyzed  to  reveal  any  unacceptable  aspects  of  sys- 
tem operation  that  may  warrant  modification  either  to  the  ATS  con- 
cept itself  or  to  some  detail  of  message  delivery. 

1.3  TliST  MhTHOI) 

Since  flight  testing  is  at  best  an  inefficient  process  for 
obtaining  engineering  data,  it  is  important  to  provide  an  adaptive 


and  flexible  test  program  as  part  of  the  system  development  and 
refinement  process.  livery  attempt  should  be  made  to  avoid  flight 
test  exploration  of  issues  that  can  be  studied  by  analysis  or  sim- 
ulation. The  flight  tests  should  focus  upon  gathering  data  un- 
attainahle  by  other  means  and  uncovering  problems  that  may  have 
been  overlooked  during  other  evaluations  of  the  concept. 

1.3.1  M i_s_s  ion  types 

The  flight  tests  will  use  three  types  of  missions.  First, 
there  will  be  Professional  Pilot  Missions  (PPM's).  During  these 
missions  trained  professional  pilots  will  fly  planned  patterns, 
variations  in  pilot  behavior  will  he  minimized,  and  the  automated 
system  will  receive  concentrated  attention.  Second,  there  will  be 
Subject  Pilot  Missions  (SPM's).  During  these  missions  general 
aviation  pilots  will  fly  general  aviation  aircraft  through  spe- 
cially planned  patterns.  For  reasons  of  safety  and  coordination, 
a professional  pilot  will  he  in  command  of  the  subject  pilot's  air- 
craft and  will  have  ultimate  responsibility  for  the  aircraft, 
although  the  subject  pilot  will  fly  the  aircraft.  F.very  effort 
will  be  made  to  provide  a normal  cockpit  environment  for  the  sub- 
ject pilot.  Subject  pilot  testing  is  expected  to  lead  to  valuable 
insights  concerning  pilot  use  of  the  advisory  messages  of  the  sys- 
tem in  lioth  conflict  situations  and  routine  flight  operations. 
Ihird,  there  will  he  Normal  Airport  Missions  (NAM'sl.  During 
these  missions  the  primary  emphasis  will  be  on  having  general 
aviation  pilots  use  the  airport  where  ATS  is  located  in  normal 
flight  activities.  While  some  pilots  may  be  asked  to  fly  certain 
types  of  operations,  such  as  missed  approaches  or  touch-and-gos, 
the  aim  will  be  to  mimic  the  activities  of  a typical  general 
a V i a t i on  airport. 

I . 3 . J 11  i gh  t_Tes  t s 

In  order  to  accomplish  both  the  System  Validation  and  the 
I’ilot  Iva  Illation  objectives,  flight  testing  will  be  accomplished 
in  t h ree  pa  r t s . 
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Tart  1 will  consist  of  checkout  flights.  The  function  of 
these  flights  is  to  debug  the  major  components  of  the  system.  The 
objective  of  this  phase  is  to  get  the  surveillance,  tracking, 
message  generation,  and  message  delivery  subsystems  in  working 
order  in  preparation  for  the  fine  tuning  to  no  done  in  subse(|uent 
phase.s.  fh  i s will  be  accomplished  through  I’PM's. 

Part  11  will  consist  of  validation  tests  and  some  pilot  eval- 
uation tests.  I'hese  flights  will  occur  at  NAI'liC.  Most,  if  not 
all,  of  the  flights  designed  to  meet  the  validation  objectives 
will  be  flown  during  this  part  of  the  test.  This  will  bo  accom- 
plisiied  with  PPM's.  .Any  major  bugs  in  the  subsystems  will  be 
fi.xed  at  this  time.  In  addition,  the  objectives  dealing  with  the 
pilot'.s  ability  to  interact  with  the  system  will  be  accomplished 
primarily  with  SPM's.  I’ilot  opinions  of  the  system  will  also  be 
measured  during  the  .SPM's.  .some  .NAM's  will  also  be  carried  out 
during  this  p.arr  ? u,.e  test  to  measure  system  and  pilot  perfor- 
mance under  a wider  variety  of  conditions.  An  interim  report, 
which  will  be  written  following  the  NAFHC  tests,  will  describe 
the  major  results  of  those  tests  and  detail  plans  for  the  Part  III 
tes  ts  . 

Part  III  will  consist  of  NAM's  at  a general  aviation  airport. 
This  part  of  the  flight  test  constitutes  the  final  evaluation  of 
the  concept.  The  primary  emphasis  will  be  on  pilot  reactions  to 
and  evaluations  of  system  characteristics  under  the  variety  of 
conditions  encountered  at  a general  aviation  airport.  An  interim 
report  describing  the  results  of  the  Part  III  tests  will  be  written 
at  their  corclusion.  In  addition,  a final  report  on  all  AT.S  flight 
'■est  activities  will  be  prepared. 

ihe  present  document  presents  the  requirement.*:  for  the  Part  II 
te.sts  at  NAFEC  and  the  Part  III  tests  at  a general  aviation  .air- 
port. The  flight  tost  retiuirement.s  for  the  evaluation  of  each  of 
the  AT.S  service.s  are  presented  in  sections  2 through  2.  In  each 
section  there  is  a short  description  of  the  service,  a listing  of 
the  major  issues  involved  in  its  evaluation,  and  a discussion  of 
the  methods  to  be  used  in  the  evaluation.  The  description  of  the 

4 


‘■5 


test  methods  presents  the  types  of  missions  that  will  be  required 
along  with  a table  showing  the  measures  to  be  taken  and  the  sources 
of  data  where  those  measures  can  be  most  easily  obtained. 

Although  the  services  are  described  separately,  it  should  not 
be  assumed  that  they  will  be  evaluated  separately.  It  may  be  pos- 
sible to  gather  data  on  several  services  during  the  same  missions, 
fhe  schedule  of  missions  that  yields  the  most  efficient  evaluation 
of  the  services  should  be  used. 


2.  SYSTEM  ENTRY 
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:.l  \TR  Ol’IiRATION’S 

[n  oiJor  for  a pilot  flying  \M'R  to  gain  access  to  the  services 
I’rovidcd  by  the  Al'S  system  he  must  carry  out  a system  entry  proce- 
dure called  Login.  I’he  purpose  of  the  I.ogin  procedure  is  to  estah- 
li-ih  a communication  link  between  the  pilot  and  tlic  ATS  system. 

Mse  of  the  Login  procedure  confirms  pilot  intent  to  cooi)crate  with 
ATS  ]irocedures  and  provides  a means  for  the  ATS  computer  to  acquire 
an  aircraft  identification  to  be  used  in  directing  voice  messages 
to  that  pilot.  Since  the  benefits  the  system  provides  cannot  be 
obtained  without  a successful  Login,  insuring  the  smooth  coordina- 
tion between  the  pilot  and  the  system  the  procedure  requires  is  one 
of  the  top  priorities  of  the  flight  test  program.  If  Login  errors 
occur  frequently,  either  because  of  system  malfunction  or  pilot 
jUM  formance , acceptance  o'"  the  ATS  will  be  jeopardized. 

k The  ATS  concept  description  presents  two  alternative  I.ogin  pro- 

cedures. In  both,  the  pilot  begins  Login  on  arrival  by  tuning  to 
the  airport's  Login  frequency  about  15  miles  from  the  airport  and 
squawking  the  airport's  assigned  transponder  code.  On  departure 
the  pilot  squawks  the  code  when  he  is  on  the  ramp.  In  both  cases 
the  system  then  broadcasts  a message  giving  the  aircraft's  position, 
from  this  point  on  the  two  Login  procedures  differ.  In  the  Trans- 
ponder ID  procedure  the  pilot  is  given  a unique  transponder  code  to 
he  used  as  his  It'.  Once  the  pilot  squawks  that  code,  the  system 
sends  a message  that  the  aircraft  is  logged  in.  All  subscH)uent  mes- 
sages to  that  aircraft  will  be  prefaced  with  that  trnnsjionder  code. 

j In  the  \oice  ID  procedure,  tlie  pilot  sc|uawks  the  airport  code 

and  the  system  sends  a message  giving  the  aircraft's  position.  The 
pilot  is  asked  to  "say  your  IP."  The  pilot  broadcasts  a descriji- 

i lion  of  his  aircraft,  which  may  include  a portion  of  the  tail  num- 

! her.  The  system  then  records  the  description.  I'he  des  c r i ]tt  i on  may 

be  up  to  5 seconds  long.  However,  it  is  expected  that  on  the  aver- 
age it  will  !)c  shorter.  The  IP  is  then  broadcast  back  to  the  pilot 
along  with  a discrete  transponder  code.  Once  the  i">ilot  squawks 
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the  code  lie  receives  a message  that  he  is  logged,  and  all  subse- 
quent messages  arc  prefaced  with  this  Voice  Il>. 

One  of  the  major  issues  to  be  resolved  during  the  flight  test 
is  whether  the  Voice  111  procedure  will  allow  relatively  error-free 
Login.  Despite  the  fact  that  the  Voice  ID  procedure  takes  more 
time  and  requires  closer  coordination  between  the  pilot  and  the 
system,  it  has  the  following  advantages  over  the  Transponder  ID 
ji rocedure ; 

a.  Messages  sent  with  a Voice  ID  are  similar  to  those  nor- 
mally received  from  controllers.  This  should  allow  the  pilot  to 
recognize  more  easily  messages  directed  to  him.  Since  the  pilot 
has  other  cockpit  duties  to  perform,  listening  for  an  arbitrarily 
assigned  code  that  may  differ  by  only  one  or  two  numbers  from 
another  aircraft's  may  be  more  difficult  than  listening  for  his 
own  voice. 

b.  The  \'oice  ID  allows  pilots  to  identify  other  aircraft 
receiving  messages.  Since  the  aircraft  type  and  tail  number  may 
he  paiM  of  the  ID,  a pilot  would  often  be  able  to  locate  another 
aircr.ilt  receiving  a message  and  thereby  get  a better  picture  of 
The  traffic  situation  around  him.  This  could  only  be  done  by  in- 
ference witli  the  Transponder  ID. 

c.  \nothcr  potential  benefit  is  that  there  may  be  fewer  re- 
ijiicsts  for  repetition  of  a message  with  the  Voice  ID.  Although 
some  form  of  message  repetition  service  is  contemplated  for  ATS, 

Its  form  will  not  he  determine<l  until  the  flight  test.  If  pilots 
are  allowed  to  request  a repetition  of  a message  they  did  not 
understand,  the  higher  intelligibility  of  the  Voice  IP  should  pro- 
duce fewer  requests.  This  means  that  although  the  Voice  ID  pro- 
cedure would  take  more  time  on  the  l.ogin  channel,  it  would  result 
in  fewer  messages  being  sent  on  the  operational  channel. 

These  advantages  to  the  Voice  ID  make  it  imiiortant  to  thor- 
ough I >•  test  and  debug  flu'  procedure  and  expose  it  fo  pilots  with 
varying  levels  of  experience.  Although  some  preliminary  testing 
of  the  Transponder  ID  procedure  should  he  planned,  a full  evaluation 
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ol'  it  will  occur  only  if  the  Voice  ID  procedure  is  unacceptable. 

In  addition  to  the  type  of  II),  there  arc  two  other  aspects 
of  I.ogin  to  be  tested.  First,  the  ability  of  the  system  to  ileal 
with  two  pilots  attempting  to  log  in  simultaneously  will  be  eval- 
uated. When  two  aircraft  squawk  the  airport  code  at  nearly  the 
same  time,  ATS  requests  the  first  aircraft  to  log  in  by  including 
t!ie  aircraft's  position  in  the  request.  However,  if  tlie  aircraft 
are  near  each  other  or  one  pilot  is  not  sure  where  he  is,  they  may 
both  attempt  to  log  in.  The  system  is  capable  of  dealing  with  this 
situation  in  several  ways.  It  can  request  that  a pilot  restart 
Login,  and  it  can  recognize  which  aircraft  is  squawking  the  trans- 
ponder code  it  has  given,  even  if  it  is  the  wrong  aircraft,  and  re- 
quest that  the  other  pilot  log  in.  What  is  not  clear  is  how  pilots 
will  react  to  this  situation  or  how  long  the  Login  process  will 
take.  Second,  the  feasibility  of  an  ATS  system  with  one  frequency 
for  both  Login  and  Lical  messages  will  be  tested.  This  single- 
channel  system  has  the  advantage  of  allowing  pilots  to  hear  eacli 
other  log  in  and  thereby  increase  awareness  of  traffic  in  the 
area.  However,  the  point  at  which  the  number  of  messages  saturates 
the  channel  or  becomes  unacceptable  to  pilots  must  be  determined. 

Once  Login  has  been  successfully  completed,  an  Automatic  Ter- 
minal Information  Service  (ATIS)  message  is  broadcast.  This  mes- 
sage includes  the  active  runway,  weather,  number  of  aircraft  logged 
into  the  system,  the  frequency  of  the  ATS  tactical  channel,  and  spe - 
cial  information  such  as  that  found  in  NOTAMS.  As  traffic  density 
increases  it  may  not  be  necessary  to  broadcast  the ATIS  message 
after  every  Login.  This  would  increase  the  capacity  of  the  system. 
However,  the  point  at  which  the  message  need  not  be  broadcast  after 
every  I.og  in  must  be  established  during  the  test  as  well  as  the 
acceptab  i 1 i ty  of  this  procedure  to  pilots.  In  addition,  the  single 
channel  version  of  ATS  does  not  broadcast  the  ATIS  message  after 
l.ogin  but  on  a regular  (e.g.,  every  3 minutes)  schedule.  How  well 
this  procedure  works  with  high  density  traffic  must  be  established 
during  the  tests. 
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I r-R  opl;r/\tions 


2 ,■> 

The  system  entry  procedure  for  a pilot  flying  IFR  is  somewhat 
different  from  the  procedure  for  VPR  flights.  How  different  will 
depend  on  the  equipment  available  at  the  particular  ATS  airport. 
Basically  there  are  three  possibilities: 

1.  The  airport  has  no  RCO  and  no  digital  interface  with  the 
nearest  ATC  facility.  On  arrival  into  the  airport  area  the  pilot 
is  given  an  ITR  transponder  code  for  ATS  by  the  approach  controller 
over  the  approach  control  frequency.  The  pilot  then  switches  to 
the  ATS  tactical  frequency  10  miles  from  FAF  and  squawks  the  code. 
The  system  recognizes  the  code  and  requests  that  the  pilot  log  in. 
From  this  point  on  the  procedure  is  the  same  as  for  a VFR  flight. 

On  departure  the  pilot  receives  his  clearance  by  telephone.  It 
contains  the  discrete  transponder  code  assigned  under  the  National 
Beacon  Code  Allocation  plan  for  his  IFR  flight.  When  the  pilot  is 
on  the  ramp  ready  to  depart  he  squawks  tliis  code.  When  ATS  sees  a 
transponder  on  the  ramp  with  any  of  the  codes  allowable  for  IFR 
flights,  it  assumes  an  IFR  departure  is  ready  and  requests  the  air- 
craft initiate  I.ogin.  The  rationale  behind  having  the  IFR  aircraft 
log  in  on  the  tactical  frequency  is  to  avoid  requiring  the  pilot 

to  make  two  frequency  changes. 

There  are  tvv'o  aspects  of  this  IFR  Login  that  need  to  be 
probed  [luring  the  tests.  ihe  first  is  the  timing  of  the  handoff 
to  and  from  ATC.  On  arrival  once  the  pilot  switches  to  the  ATS 
frequeircy  10  miles  from  FAF  the  approach  controller  cannot  talk  to 
the  pilot.  Furthermore,  until  the  pilot  is  logged  he  cannot  receive 
ATS  services.  The  smooth  functioning  of  this  handoff  ami  its  accep- 
tability to  pilots  and  controllers  must  be  demonstrated  during  the 
tests.  Second,  the  impact  and  acceptability  of  Login  on  the  tacti 
cal  frequency  must  be  assessed,  especially  as  traffic  density  in- 
creases . 

2.  Ihe  airport  has  an  RCO.  On  arrival  the  procedure  for 
pilots  is  the  s.ime  as  describeii  above.  However,  the  a(i['roach  con- 
troller wi  II  be  able  to  monitor,  anil  if  necessarv  break  into,  t tu' 

AI'AI  channel  all  the  way  to  touchdown.  On  departure,  t lu'  pilot  c.in 
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receiv'c  his  clearance  over  the  RCO  but  otherwise  the  procedure  is 
the  same  as  above.  However,  the  departure  controller  can  monitor 
and  if  necessary  break  into  the  ATS  channel. 

3.  If  the  airport  has  a digital  ground  link  to  ATC  the  pro- 
cedure is  greatly  simplified.  Here  the  transponder  code  and  ID 
are  sent  directly  to  the  ATS  computer.  The  pilot  simply  squawks 
his  I FR  code.  He  is  already  logged  into  the  system.  In  addition, 
the  ATC  controller  receives  surveillance  data  on  the  aircraft  until 
touchdown.  On  departure,  ATC  tells  the  ATS  computer  the  transponder 
code  and  departure  route  of  the  aircraft.  Again,  the  pilot  docs 
not  have  to  log  in,  and  the  handoff  to  ATC  can  be  done  automatically. 
I'he  major  issues  to  be  investigated  here  are  the  timing  of  the  hand- 
off ami  the  acceptability  of  the  procedures  to  pilots. 

all  three  of  these  cases  the  pilot  has  two  other  options 
he  may  wish  to  take  at  this  rime.  First,  he  may  wish  to  make  a 
practice  IFR  approach.  He  does  this  by  simply  informing  the  ap- 
proach controller.  The  controller  then  gives  him  an  appropriate 
transponder  code.  When  he  logs  in  the  system,  it  notes  his  inten- 
tion in  its  initial  message  to  him.  Otherwise,  the  Login  procedure 
is  the  same  as  for  a full  stop  landing.  Second,  the  pilot  may  wish 
to  cancel  his  IFR  flight  plan.  He  does  this  by  informing  the  ap- 
proach controller  and  then  switching  frequencies  and  squawking  the 
regular  V'FR  f.ogin  request  code. 

2.3  SYSTLM  HNTRY  KVALUATION  ISSUES 

During  the  flight  tests,  data  will  be  gathered  to  answer  the 
following  questions  about  system  entry; 

!.  What  proportion  of  ID  Logins  are  erroneous  for  both  pro- 
fessional pilots  and  subject  pilots  with  both  high  and  low  density 
traffic?  Docs  experience  with  ATS  reduce  the  number  of  errors? 

What  is  the  source  of  errors?  Can  errors  be  reduced  with  )nlot 
training  or  a change  in  the  system? 

2.  Are  Voice  ID's  intelligible  to  pilots?  How 
Is  there  a preferred  content  for  V'oice  ID's? 


long  are  they? 


3.  When  two  aircraft  attempt  to  log  in  simultaneously,  how 
long  does  it  take  to  resolve  the  conflict.  How  often  does  this 
occur? 

4.  Do  pilots  prefer  the  Voice  ID  over  the  Transponder  ID? 

5.  At  what  level  of  density  does  the  single-channel  ATS 
saturate?  Is  it  acceptable  to  pilots?  It  is  preferable  to  pilots 

(1.  What  sources  of  error  are  there  in  the  IFR  J.ogin  proce- 
dures? Can  pilots  complete  the  handoff  smoothly?  Is  the  timing 
of  the  handoff  acceptable? 

Is  rhe  Login  on  the  tactical  frequency  for  IFR  flights 
acccjitable  to  pilots?  How  much  are  Logins  delayed  under  high 
dei’siti'  conditions? 

8.  What  information  should  be  included  in  the  ATIS  message? 
Will  pilots  accept  a reduction  in  the  frequency  of  its  broadcast 
with  heavy  traffic? 

2.4  SYSTF.M  FNTRY  TIiST  MLTHODS 

Most  of  the  data  needed  to  answer  the  evaluation  issues  for 
\'IR  operations  can  be  gathered  from  PPM's  and  SPM's  during  the 
I’art  il  tests.  I’PM’s  with  two  general  aviation  aircraft  can  he 
used  to  generate  data  about  the  timing  and  intelligibility  of 
Login  mes.sages,  s>’Stcm  ma  1 funct  ions  , aiid  system  performance  with 
simultaneous  Login.  These  missions  will  also  reveal  how  experi- 
enced iiilots  can  handle  the  Login  procedures.  Questions  about 
the  handling  of  IFR  handoffs  and  Logins  can  also  be  evaluated  with 
IT'l'-  diM  ing  Part  II.  However,  the  data  needed  to  evaluate  issues 
with  low  density  traffic  about  acceptability  of  jirocedures  to 
pilot';  and  Login  errors  as  a function  of  pilot  experience  should 
lie  gathered  using  SPM's.  Data  on  message  reiietition  reciuests  and 
acceptability  with  high  density  traffic  should  receive  a prclim- 
inarv  evaluation  during  Part  II. 

It  is  expected  that  the  Part  II  tests  will  allow  a choice  to 
he  mad('  between  the  ID  proceilures  and  the  single  versus  double 
ehannel  option.  A version  of  ATS  containing  one  of  tb.ese  options 
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will  then  be  installed  at  the  operational  site  selected  for  the 
I’art  III  tests.  I'he  primary  emphasis  of  the  Part  III  tests 
should  he  on  two  types  of  evaluation.  First,  the  .system  should  he 
e.Kposed  to  a large  sampling  of  pilots,  aircraft  types,  and  commu- 
nications ecjuipment.  The  measures  taken  through  a questionnaire 
or  interview  form  will  be  especially  important  here.  Second,  the 
evaluation  of  the  system  under  high  density  traffic  conditions 
should  be  completed  during  Part  III. 

Table  1 lists  the  measures  that  will  be  needed  to  evaluate 
the  system  entry  issues.  Also  shown  are  the  mission  types  during 
which  data  will  be  gathered  and  the  sources  where  the  data  can  be 
most  easily  found.  Also,  the  table  breaks  the  test  into  high  and 
low  density  flights.  The  low  density  flights  will  require  two, 
or  at  the  most,  three  aircraft.  The  high  density  flights  will  re- 
(juire  at  least  six  aircraft  in  the  airport  area.  The  measures  that 
are  listed  for  the  1 o<  lensity  tests  will  generally  also  bt-  t;ikei\ 
during  the  high  density  tests.  Note  that  most  of  the  data  can  be 
found  on  cither  the  audio  recorder  or  the  pilot  ques t i onna i re . 

Some  software  hooks  will  be  needed,  however,  to  allow  detailed 
analysis  of  system  performance. 
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r.\BLi'  1.  MKASb'RHS,  MISSION  TYl'hS,  AN!)  SOIIROHS  Oi'  DATA 
FOR  SVSTF.M  FNTRV  FVALUATION 
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3.  SEQUENCING  AIDS 


Once  a pilot  is  logged  into  the  system,  he  gains  access  to 
the  services  provided  by  the  ATS.  During  normal  VFR  operations 
the  most  basic  services  the  system  provides  are  sequencing  aids. 

I'he  aids  are  intended  to  make  the  pilot  aware  of  the  traffic  in 
the  vicinity  of  the  airport  and  his  position  in  that  traffic. 

I'he  histor\-  of  accidents  at  uncontrolled  airports  shows  that  the 
majority  occur  in  the  traffic  pattern  area  and  that  pilots  do  not 
sec  each  other  in  time  to  make  an  evasive  maneuver.  The  sequencing 
aids  were  designed  with  this  history  in  mind.  They  were  also 
designed  to  improve  traffic  flow  at  the  entry-downwind  merge 

[Joint. 

In  normal  VFR  traffic  the  ATS  system  is  designed  to  give  each 
pilot  advisories  at  two  noints: 

1.  As  an  aircraft  approaches  the  downwind  leg  of  the  traffic 
pattern  tlie  pilot  receives  an  advisory  message  giving  the  position 
of  all  other  logged  aircraft  in  that  vicinity.  This  message  is 
broadcast  to  aircraft  entering  the  traffic  pattern  by  way  of  a 45° 
entry  to  downwind  and  to  aircraft  transitioning  to  downwind  from 

a crosswind  leg. 

2.  As  an  aircraft  flying  the  downwind  leg  flies  abeam  of  the 
runway  threshold  ATS  sends  a message  announcing  the  number  of  logged 
aircraft  ahead  in  the  landing  sequence. 

3.1  SEQUENCING  AIDS  EVALUATION  ISSUES 

One  of  the  major  questions  to  be  addressed  Citi  addition  to 
testing  whether  or  not  the  system  sends  traffic  advisories  at 
appropriate  times)  is  the  impact  of  non- transponder-equi pped  air- 
craft on  system  performance  and  acceptability.  Even  though  the 
proportion  of  equipped  general  aviation  aircraft  is  increasing, 
there  will  always  be  aircraft  with  malfunctioning  transponders. 
Current  plans  call  for  pilots  of  these  aircraft  to  make  self- 
reports  of  their  position  over  the  ATS  frequency.  It  is  unclear 
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at  [irt'scnt  whether  these  reports  will  degrade  system  performance 
or  annov  or  confuse  other  pilots.  This  should  not  happen  if  pilots 
use  good  communication  techniciues.  A potentially  more  serious 
problem,  however,  may  be  that  pilots  do  not  make  reports,  and  some 
of  the  other  aircraft  in  the  pattern  are  not  aware  of  their  pres- 
ence. 


I'or  the  test  of  the  sequencing  aids  service,  data  should  be 
gat))ered  to  answer  the  following  questions; 


a.  Are  the  sequencing  messages  broadcast  at  the  appropriate 
times,  namely  just  before  pattern  entry  and  abeam  of  the  runway 
til  res  ho  Id? 


b.  Are  the  messages  delayed  or  omitted  in  high  density 
traffic?  According  to  pilots  are  the  messages  received  on  time 
to  be  helpful?  Do  they  facilitate  the  flow  of  traffic? 


c.  Do  pilots  consider  the  messages  useful  despite  the  pres- 
ence of  unequipped  aircraft?  Do  pilots  prefer  that  the  number  of 
messages  he  minimized  in  low  density  traffic? 


d.  Do  the  messages  increase  the  pilots'  awareness  of  traffic? 

e.  Will  pilots  without  working  transponders  give  sel  f - repo  r t s 


.A.  2 SIAIUHNCINC:  AIDS  ThST  MhTHODS 


The  data  needed  to  answer  the  issues  about  whether  the  messages 
are  lieing  sent  at  appropriate  times  in  low  density  conditions  can 
be  gathered  from  IM’M's  during  the  Part  II  tests.  All  of  the  other 
issues,  however,  rcc|uire  medium  to  high  density  traffic;  i.e., 
more  than  three  aircraft  flying  in  the  pattern.  Data  on  these 
questions  could  be  gathered  using  SPM's,  hut  NAM's  with  a ques- 
tionnaire would  be  most  efficient.  If  tlie  messages  are  leccived 
on  time,  even  under  high  density  conditions,  the  gathering  of 
evidenci-  on  whether  the  messages  increase  jii  lots'  awareness  of  other 
traffic  will  he  essential  to  the  flight  test.  If  the  s vs  tern  is 
going  to  help  prevent  accidents  at  uncontrolled  airpoits  it  must 
he  ahli-  to  increasi'  awareness.  Although  the  issues  involving  the 
impact  of  unequipped  aircraft  on  system  performance  and  accepta 
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bility  should  receive  some  preliminary  test  during  the  Part  II 
flights,  the  questions  can  best  be  resolved  during  the  Part  III 
flights.  This  is  especially  true  of  the  question  of  whether  pilots 
of  unequipped  aircraft  will  give  self  reports. 

fable  2 lists  the  measures,  mission  types,  and  sources  of  data 
that  will  be  needed  to  evaluate  the  sequencing  aids  issues.  As  can 
be  seen  the  sequencing  aid  evaluation  relies  more  heavily  on  the 
pilot  questionnaire  and  the  software  hooks  than  the  system  entry 
eva 1 uat ion  . 


MF.ASURKS,  MISSION  TVl’FS,  AND  SODKCFS  OF  I)A1A  FOR 
SEQUENCING  AIDS  HVAHJAFION 
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THREAT  DETECTION  SERVICE 

If  t ho  soquencing  aids  service  works  as  designed  and  if  it 
could  he  assumed  that  all  pilots  fly  flawlessly,  there  would  be  no 
need  for  a threat  detection  service.  When  a pilot  approaches  the 
traffic  pattern  area  he  is  made  aware  of  other  traffic  in  the 
vicinity,  and  as  he  passes  abeam  of  the  runway  threshold  his 
place  in  the  landing  sequence  is  noted.  Conflicts  should  never 
occur,  hut  un  fo  r t una  t el  y , they  will.  liven  at  airports  with 
skilled  and  disciplined  pilots  and  a tower  controller  conflicts 
occasionally  arise.  In  fact,  one  of  the  primary  functions  of  a 
tower  controller  is  to  assure  separation  between  aircraft.  ATS 
incorporates  this  function  by  providing  warnings  to  two  or  more 
conflicting  aircraft.  The  service  is  designed  for  the  ATS  traffic- 
area  (5-mile  radium-,  cUOO  ft  AGL)  and  is  geared  toward  alerting 
pilots  to  conflicts.  However,  threat  detection  for  the  rest  of  the 
ATS  radar  coverage  area  will  be  extended  to  logged  aircraft.  The 
detection  logic  examines  each  aircraft  pair  and  compares  their 
relative  positions  and  velocities.  The  criterion  used  in  deter- 
mining that  a conflict  exists  are  time  to  collision,  miss  distance, 
and  range. 

The  most  difficult  service  to  set  flight  test  requirements  for 
is  threat  detection.  There  are  three  reasons  for  this.  First, 
there  are  an  infinite  number  of  combinations  of  encounter  geome- 
tries, pattern  locations,  aircraft  performance  characteristics,  and 
pilot  experience  variables.  Obviously,  some  subset  of  these  must 
be  chosen  for  planned  tests.  Second,  the  conflict  warnings  given 
to  pilots  arc  not  commands.  They  inform  the  pilot  of  a conflict 
but  do  not  tell  the  pilot  to  take  a specific  action  to  avoid  a 
collision.  At  the  present  time  it  is  unclear  how  pilots  will  react 
to  such  messages.  Some  pilots,  however,  may  react  to  a message 
by  making  maneuvers  that  put  them  into  another  and  more  serious 
conflict.  The  variety  of  sucli  reactions  obviously  cannot  be  an- 
ticipated in  advance  to  allow  specific  requirements  to  be  set. 
Third,  the  exact  timing  of  the  conflict  messages  is  not  constant. 
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Normal  variations  in  the  surveillance  and  tracking  systems  produce 
variations  in  the  timing  of  messages. 

i ho  basic  problem  with  setting  requirements,  then,  is  to 
specify  a set  of  conflict  situations  to  test,  while  at  the  same  time 
leaving  the  test  schedule  flexible  enough  to  further  explore  situa- 
tions that  may  apj>ear  during  the  tests.  A reasonable  solution  to 
these  jiroblcms  is  to  plan  to  test  the  conflict  situations  explored 
liy  the  Ml  i'RI:  Corporation  and  at  the  same  time  be  ready  to  further 
explore  other  serious  conflict  situations  that  ajipear  during  the 
test  phases.  I'his  strategy  has  the  additional  benefit  of  pro- 
viding some  validation  for  the  simulation.  If  the  simulation  proves 
to  be  accurate,  it  can  be  a tremendous  aid  to  intensive  investiga- 
tions of  new  conflict  situations. 

Ihe  conflicts  selected  by  MITRE  to  simulate  are  those  which 
have  a history  of  occurring  at  uncontrolled  airports.  The  follow- 
ing four  scenarios  and  their  variations  were  simulated: 

1.  Overtake  on  downwind. 

2.  One  aircraft  entering  the  pattern  and  another  on  downwind. 

"•> . One  aircraft  entering  the  pattern  and  another  on  cross- 

w i nd  . 

1,  One  aircraft  on  final  approach  and  another  turning  from 
b :i s e to  final. 

With  the  addition  of  a conflict  with  an  enroute  aircraft  the 
most  frequently  occurring  conflicts  are  covered  by  these  situa- 
tions. ITie  test  plan,  then,  should  include  planned  flight  scenar-  J 

ios  to  exjilore  tliese  five  types  of  conflict.  ’ 


■l.l  niRbAT  DETIiCTION  HVAI. HATTON  I.SSIIES 

Till'  m.ijor  issues  to  be  evaluated  during  the  threat  detection 
te-'ts  .lie  fl)  whetlier  alarm  messages  are  sent  on  time  to  enable 
pilots  to  lesolvo  conflicts  and  (21  whether  pilots  le.ict  to  alarm 
me'.sares  bv  putting  themselves  in  further  conflicts.  An  im]iortant 
rel.iti'd  issue  is  whether  false  alarm  messages  are  sent.  It  is 
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common  practice  to  hav'e  aircraft  with  different  per formance  char- 
acteristics fly  in  the  pattern  not  only  with  horizontal  si-paration, 
hut  also  with  vertical  separation.  iliyher  ]ierformance  airciaft 
tend  to  fly  hii;her  and  wider  patterns.  If  aircraft  do  m ' have 
'lode  t'  1 1 ans]iondcrs  hut  are  vertically  separated,  the  .v'.iein  ni.iy 
hroaticast  an  alarm  messatje.  This  may  he  anno>inj’  to  pilots  and 
cause  delays  in  other  service  messages.  .Since  the  AIS  .1 1 roi  1 1 Inns 
>;ive  the  hijthest  priority  to  alarm  messages,  having  false  al.irms 
in  heavy  traffic  conditions  could  disrujit  the  other  services. 

Ihere  are,  then,  three  major  areas  that  must  be  cxitlored  dur 
i ng  the  threat  detection  tests; 

1.  .*\re  the  timing  and  order  of  the  alarm  messages  sufficient 
for  pilots  to  avoid  collisions?  Arc  they  acceptable  to  pilots? 

Do  false  al.irms  occur  frequently? 

2.  How  are  con^'iicts  resolved?  Are  some  conflicts  more 

( difficult  to  resolve  than  others? 

I .1.  Do  p i lot  - generated  avoidance  maneuvers  produce  additional 

j conf 1 i ct  s? 

i 

I 4.2  THRIiAT  DTTLCTI O.N  TEST  METHODS 

r 

All  tests  involving  planned  flight  scenarios  will  be  conducted 
during  the  F’art  II  tests.  The  system  validation  issues  involving 
the  determination  of  whether  the  alarm  messages  are  being  sent  as 
designed  should  be  conducted  using  PPM's.  Most  of  the  basic  tests 
can  be  done  with  two  aircraft.  The  questions  about  pilot  accepta- 
, bility  and  pilot  avoidance  maneuvers  must  be  done  with  subject 

’ pilots  flying  planned  scenarios.  The  flight  exiierience  of  the 

subject  pilots  chosen  for  the  tests  should  vary  widely.  It  is 

I important  to  measure  the  reactions  of  both  new  an<l  experienced 

pilots  to  the  alarm  messages. 

' Perhaps  the  most  difficult  issue  to  resolve  during  the  flight 

tests  will  be  the  impact  of  conflicts  or  false  alarm  messages 
tiuring  heavy  traffic.  Because  the  ATS  algorithms  put  the  highest 
priority  on  conflict  alarms,  a series  of  conflict  or  false 
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alarm  messages  Juring  heavy  traffic  could  seriously  disrupt  the 
other  A 1 S services.  However  difficult  it  is  to  set  up  conflicts 
in  heavy  traffic  (six  or  more  aircraft  in  the  pattern),  they  must 
he  conducted  before  the  system  is  moved  for  the  Part  III  tests. 

Some  very  important  data  on  threat  detection  can  be  gathered 
during  1 tie  N'AM's  during  both  the  Part  II  and  the  Part  III  tests. 
Unplanned  conflicts  will  arise.  System  performance  and  pilot 
reactions  during  these  conflicts  should  be  carefully  scrutinized 
for  clues  to  potential  problems.  If  any  appear,  further  tests  at 
NAirdd  or  an  intensive  simulation  effort  may  be  called  for. 

iablc  3 lists  the  measures,  mission  types,  and  sources  of 
data  for  the  threat  detection  evaluation.  .Note  that  the  evalua- 
tion of  this  service  relies  neavilv  on  software  hooks. 


TAKLIi  3.  MHASURKS,  MISSION  TYI’F.S,  AND  SOURCFS  OF  DATA  TOR 
rilRHAF  DHTFCTION  FVALUATION 


5.  IFR  SERVICES 


Om.0  a pilot  flying  IFR  is  logged  into  the  system,  he  gains 
access  to  the  services  given  to  pilots  flying  VFR.  In  addition, 
he  receives  services  specifically  designed  for  IFR  aircraft.  These 
are  of  three  basic  types: 

1.  IFR  announcements  - IFR  arrivals  will  be  announced  when 
they  first  enter  the  ATS  traffic  area.  An  announcement  is  also 
broadcast  when  the  aircraft  is  3 miles  and  1 mile  from  the  center 
ol  the  runway.  One  final  announcement  will  note  the  IFR  aircraft's 
seciuence  to  land.  IFR  aircraft  departing  the  airport  will  receive 
similar  messages  at  1,  3,  and  5 miles  from  the  airport. 

2.  Approach  monitoring  - During  the  entire  approach  the  sys- 
tem will  compute  deviations  from  the  approach  centerline  and  broad- 
cast significant  deviations.  If  the  aircraft  has  a Mode  C trans- 
I)onder  ;i  message  will  be  broadcast  if  the  lowest  minimum  descent 
altitude  is  penetrated.  The  pilot  will  also  be  informed  when  he 
has  passed  the  mi ssed- approach  point. 

3.  Outbound  handoff  - At  an  appropriate  outbound  handoff 
range,  ;i  message  will  prompt  the  pilot  to  change  frequencies  and 
contact  Arc. 

5.1  IFR  SHRVICF.S  F.VALUATION  ISSUES 

I'o  .1  large  extent  the  success  of  the  IFR  services  will  depend 
on  the  cooi>eration  of  ATC  facilities  in  the  vicinit>  of  the  A I'S 
.lirport.  However,  the  flight  test  should  concentrate  on  whether 
the  messages  are  broadcast  at  the  correct  time  and  whether  thev  arc 
.icccp  r.ih  I e to  pilots.  Basically,  there  are  only  two  issues  in  the 
evaluation  of  the  IFR  services: 

1.  Are  the  IFR  announcements  and  approach  monitoring  messages 
hro.'uhast  at  the  appropriate  times?  Arc  these  mess.iges  delayed  or 
omitteil  under  heavy  traffic  conditions?  If  so,  is  this  acceptable 
to  [)  i I o t s ? 
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1.  Is  rlu'  outbound  handoff  completed  snioothlv?  Is  the  inessam- 
delayed  in  heavy  traffic?  Is  the  timing;  of  the  procedure  acceptable 
to  pilots  and  A TC  facilities? 


5.2  IfR  ShKVIChS  TIiST  MliTHODS 


I'he  questions  involving  the  timing  of  messages  in  low  density 
traffic  can  be  answered  with  PPM's  during  Part  II.  Evaluating 
the  approach-monitoring  messages  will  require  flying  planned  pat- 
terns with  deviations  from  normal  appraches . The  timing  and 
acceptability  of  messages  in  heavy  traffic  should  receive  a pre- 
liminary test  with  NAM'S  during  Part  II.  The  complete  evaluation 
can  be  done  during  Part  111.  Evaluating  this  service  does  not  rc- 
qu i re  us i ng  SPM ' s . 


Table  4 lists 
lor  the  evaluation 


the  measures,  mission 
of  I services. 


t ypes  , 


and  sources  of  data 
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TABLE  4.  MEASURES,  MISSION  TYPES,  AND  SOURCES  OE  DATA 
FOR  IFR  SERVICE  EVALUATION 
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6.  PATTERN  MANAGEMENT  SERVICES 

The  functions  of  the  pattern  management  services  are  to  main 
tain  a standard  traffic  pattern,  to  keep  control  of  pattern  den- 
sity, accommodate  special  operations,  and  reduce  waiting  time  on 
; departure.  Basically  there  are  three  types  of  messages: 

1.  Messages  to  maintain  the  traffic  pattern  - Pilots  will  he 
required  to  fly  a standard  right  or  left  pattern  with  standard 
entr>-  and  departure  procedures.  A pilot  attempting  to  enter  the 
traffic  area  in  other  than  the  entry  corridor  receives  a warning 
that  he  is  making  an  improper  entry.  Pilots  who  are  in  the  traffic 
pattern  and  not  conforming  to  the  standard  pattern  will  also  re- 
ceive a warning  that  they  are  flying  a nonstandard  pattern.  i'liese 
messages  will  not  be  given  to  IFR  aircraft,  and  they  are  not  de- 
signed to  be  restrictive.  They  will,  however,  require  some  dis- 
cipline on  the  jiart  o^  pilots  using  an  ATS  airport.  In  addition 
to  attempting  to  maintain  a standard  pattern,  the  ATS  system  will 
also  draw  special  attention  to  runway  changes.  Messages  to  an- 
nounce the  opening,  closing,  or  reversal  of  a runway  will  be  given 
at  1-minute  intervals  and  continue  for  a sufficient  period  to  allow 
the  aircraft  to  alter  their  flight  paths.  The  major  issues  to  be 
explored  during  the  flight  test  are  the  acceptab i 1 i ty  of  these 
messages  to  pilots  and  the  establishment  of  special  conditions 
under  which  the  criteria  for  generating  these  messages  should  he 
made  either  more  strict  or  more  lax. 

1.  Messages  to  reduce  delay  — A large  fraction  of  tlie  oiiera- 
I tions  at  a general  aviation  airport  are  practice  flights.  This 

can  result  in  significant  delays  to  aircraft  waiting  to  depart. 

Al'S  has  two  procedures  for  dealing  with  this  problem.  Pirst,  it 
requests  individual  aircraft  that  have  been  executing  multiple 
touch-and-gos  to  join  the  departure  queue,  thereby  creating  a break 
i in  the  circulation  around  the  pattern.  If  delays  are  still  too  long. 

ATS  can  rcuiuest  that  all  touch-and-go  operations  be  stopped  for  a 
fixed  length  of  time.  There  is  also  a special  message  to  request 
cessation  of  practice  operations  on  a crossing  runw.ay.  Second, 
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ATS  can  attempt  to  open  a "slot"  in  the  pattern  to  enable  the  de- 
parture of  several  aircraft.  It  does  this  by  requesting  that  an 
aircraft  passing  the  runway  threshold  extend  his  downwind  1 mile. 
During  the  flight  tests  the  major  issues  to  be  explored  will  be 
adjustments  of  the  timing  of  these  messages  to  effectively  reduce 
delay  and  the  acceptability  of  these  messages  to  pilots. 

3.  Messages  to  accommodate  special  operations  — ATS  allows 
a pilot  to  use  an  alternate  runway  as  long  as  the  pilot  makes 
known  his  intention  by  using  a special  transponder  code  at  I.ogin. 

Ihc  system  provides  announcements  to  alert  the  rest  of  the  traffic 
to  a crossing  runway  operation  or  a nonstandard  departure.  Again, 
the  major  issue  to  be  evaluated  during  the  tests  is  the  accepta- 
bility of  these  messages  to  pilots.  In  addition,  some  further  ser- 
vice messages  for  crossing  runway,  taxi,  and  takeoff  operations 
may  be  explored  during  the  tests. 

h.l  PATTTRN  MANAGEMENT  SERVICES  EVALUATION  ISSUES 

During  the  flight  tests,  data  will  be  gathered  to  answer  the 
following  questions  about  pattern  management  services: 

a.  Are  there  special  conditions  under  which  criteria  for 
generating  nonstandard  pattern  messages  should  be  adjusted?  Are 
the  timing  and  content  of  the  nonstandard  pattern  messages  accept- 
able to  pilots? 

b.  Are  changes  in  runway  status  accomplished  smoothly?  If 
not,  should  the  timing  and  content  of  these  messages  be  changed? 

c.  Are  the  messages  that  are  designed  to  reduce  delay  effec- 
tive? Should  the  criteria  for  their  generation  and  order  be  ad- 
iiisted  for  special  conditions?  Arc  the  timing  and  content  of  these 
messaj'.es  ;uce])tahl  c to  pilots? 

d.  Docs  the  system  effectively  accommodate  alternative  runway 
operations  and  nonstandard  departures?  Will  additional  services  be 
requested  to  increase  the  flexibility  of  the  system?  Do  pilots  con- 
sider these  messages  an  asset  to  the  system? 
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6.2  PATTRRN  MANAC.EMI'NT  SERVICES  TEST  MimiODS 

Eor  the  most  part,  the  pattern  management  services  will  have 
to  be  evaluated  during  the  Part  III  tests.  The  variety  of  situa- 
tions that  have  to  be  flown  to  adjust  the  criteria  for  messaf.es 
and  to  measure  delay  under  high  density  traffic  conditions  can  he 
achieved  most  effectively  at  an  operating  airport.  In  addition, 
the  evaluation  will  be  made  to  a large  extent  on  the  basis  of  a 
sampling  of  pilot  opinion.  This  can  be  more  easily  gathered  at 
a general  aviation  airport.  Professional  pilots  flying  planned 
missions  during  Part  II  could  be  used  to  insure  that  the  non- 
standard pattern  messages  and  the  runway  status  message  are  de- 
livered on  time  in  low  density  traffic.  However,  even  here  the 
final  evaluation  will  be  completed  during  Part  III. 

Table  5 lists  the  measures,  mission  types,  and  sources  of  data 
for  the  evaluation  of  the  pattern  management  services. 


TABLK  5.  MKASURKS,  MISSION  TYPliS,  AND  SOURCES  01-  DAI  A lOR 
PATTERN  MANAGEMENT  EVALUATION 


7.  PILOT  AND  EMERGENCY  AIRCRAFT  SERVICES 

The  function  of  the  pilot  services  is  to  provide  assistance 
to  a pilot  operating  in  the  radar  coverage  area  in  addition  to 
those  services  already  described.  At  the  present  time  two  ser- 
vices have  been  developed,  although  additional  services  may  be  in- 
vestigated during  the  flight  tests.  The  two  services  are: 

1.  Position  fix  - To  obtain  a position  fix  from  ATS  the  pilot 
squawks  a sej>arate  published  transponder  code.  Only  logged  air- 
craft can  utilize  this  service.  On  request  the  system  will  broad- 
cast the  number  of  miles  and  the  direction  in  degrees  to  the  air- 
port. The  pilot  then  returns  to  his  assigned  code.  This  message 
has  a low  priority  in  the  system  and  it  may  be  turned  off  in  heavy 
traffic.  It  is  not  meant  as  an  emergency  service  but  as  an  added 
convenience  that  can  be  obtained  if  the  channel  is  free.  The  major 
evaluation  issue  is  th«  adjustment  of  the  criteria  for  terminating 
the  service  in  heavy  traffic. 

2.  Message  repetition  - A pilot  may  miss  a portion  of  a 
message  which  was  broadcast  on  the  tactical  frequency.  This  ser- 
vice is  intended  to  allow  the  pilot  to  receive  that  message.  How- 
ever, at  the  present  time  it  has  not  been  decided  specifically  how 
the  pilot  will  signal  the  system  that  he  wants  a repetition,  or 
whether  all  messages  can  be  repeated  rather  than  just  the  general 
messages  to  all  aircraft.  These  issues  will  be  decided  during  the 
tests. 

In  addition  to  these  pilot  services  there  is  one  other 
service  that  has  not  been  discussed:  a service  for  emergency  air- 

craft. Any  aircraft  squawking  7600  or  7700  in  the  airport  traffic 
area  will  be  given  emergency  status  by  ATS.  Announcements  of  the 
aircraft's  position  will  be  broadcast  at  1-minute  intervals  and  no 
messages  will  be  directed  to  that  aircraft.  When  the  aircraft  de- 
parts from  the  traffic  area  or  lands,  a final  message  will  be  sent. 
The  major  issue  to  be  resolved  during  the  tests  is  whether  ATS 
recognizes  the  code  and  broadcasts  the  messages. 


30 


:.l  I'll. or  .‘\.ND  ll.MHRCENCY  AIRCRAFT  SERVICES  EVALUATION  ISSUES 


lUirini;  the  flight  tests,  data  will  be  gathered  to  answer  the 
following  questions  about  pilot  and  emergency  aircraft  services: 

a.  Hoes  ATS  give  accurate  position  information  on  request? 

At  what  level  of  channel  saturation  and/or  traffic  density  should 
the  service  he  omitted?  Is  this  point  acceptable  to  pilots? 

b.  Ilow  should  pilots  request  repetition  of  a message?  Should 
a [)ilot  be  allowed  to  request  a repetition  of  all  messages  or  only 
geneial  messages?  How  many  requests  are  normally  made?  Can  some 
change  be  made  in  the  system  to  reduce  the  number  of  requests? 

c.  Does  the  system  respond  at  1-minute  intervals  to  an  emer- 
gency code?  Is  this  procedure  acceptable  to  pilots? 

7.2  PILOT  AN'U  EMERGE.NCY  AIRCRAFT  SERVICES  TEST  METHODS 

All  of  these  services  should  be  evaluated  during  both  the  Part 
11  and  Part  111  tests.  During  Part  II  PPM's  can  be  flown  to  gather 
data  on  the  accuracy  of  the  position  fix  message,  the  generation 
of  emergency  aircraft  messages,  and  the  procedure  for  message  repe- 
tition. I'he  Part  III  tests  would  then  be  used  for  adjusting  the 
criteria  for  omission  of  the  position  fix  message,  assessing  pilot 
acceptance  of  the  emergency  aircraft  messages,  and  evaluating  the 
message  repetition  service  with  a variety  of  pilots  and  equipment 
and  at  high  traffic  levels. 

Table  (i  lists  the  measures,  mission  types,  and  sources  of  data 
for  the  e\'aluation  of  the  pilot  and  emergency  aircraft  services. 
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